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Abstract 

We introduce /-divergence, a concept from information theory and 
statistics, for convex bodies in R™. We prove that /-divergences are 
SL(n) invariant valuations and we establish an affine isoperimetric 
inequality for these quantities. We show that generalized affine surface 
area and in particular the L p affine surface area from the L p Brunn 
Minkowski theory are special cases of /-divergences. 



1 Introduction. 

In information theory, probability theory and statistics, an /-divergence is 
a function Df(P,Q) that measures the difference between two probability 
distributions P and Q. The divergence is intuitively an average, weighted by 
the function /, of the odds ratio given by P and Q. These divergences were 
introduced independently by Csiszar [2], Morimoto [37] and Ali & Silvey pQ. 
Special cases of /-divergences are the Kullback Leibler divergence or relative 
entropy and the Renyi divergences (see Section 1). 

Due to a number of highly influential works (see, e.g., [I] - |14j . |15| . 

the Lp-Brunn-Minkowski theory is now a central part of modern convex 
geometry. A fundamental notion within this theory is L p affine surface area, 
introduced by Lutwak in the ground breaking paper |26j. 

It was shown in [52] that L p affine surface areas are entropy powers 
of Renyi divergences of the cone measures of a convex body and its polar, 
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thus establishing further connections between information theory and convex 
geometric analysis. Further examples of such connections are e.g. several 
papers by Lutwak, Yang, and Zhang [281 USB E2J [33] and the recent article 
|39j where it is shown how relative entropy appears in convex geometry. 

In this paper we introduce /-divergences to the theory of convex bod- 
ies and thus strengthen the already existing ties between information theory 
and convex geometric analysis. We show that generalizations of the L p affine 
surface areas, the and L$ affine surface areas introduced in [23J and [2Tj . 
are in fact /-divergences for special functions /. We show that /-divergences 
are SL(n) invariant valuations and establish an affine isoperimetric inequal- 
ity for these quantities. Finally, we give geometric characterizations of /- 
divergences. 

Usually, in the literature, /-divergences are considered for convex func- 
tions /. A similar theory with the obvious modifications can be developed 
for concave functions. Here, we restrict ourselves to consider the convex 
setting. 

Further Notation. 

We work in M n , which is equipped with a Euclidean structure (•,•). We write 
B'2 for the Euclidean unit ball centered at and S"™^ 1 for the unit sphere. 
Volume is denoted by | • | or, if we want to emphasize the dimension, by 
vold(A) for a (/-dimensional set A. 

Let /Co be the space of convex bodies K in W 1 that contain the origin 
in their interiors. Throughout the paper, we will only consider such K. For 
K G /C , K° = {y G W n : (x, y) < 1 for all x G K} is the polar body of K. 
For a point x G dK, the boundary of K, Nk(x) is the outer unit normal in 
x to K and kk(x), or, in short k, is the (generalized) Gauss curvature in 
x. We write K G Ci, if K has C 2 boundary dK with everywhere strictly 
positive Gaussian curvature kk- By \i or fix we denote the usual surface 
area measure on dK and by a the usual surface area measure on S 71 ^ 1 . 

Let K be a convex body in lR n and let u G S"" -1 . Then Hk(u) is the 
support function of K in direction u G S 71 ^ 1 , and is the curvature 

function, i.e. the reciprocal of the Gaussian curvature kk(x) at the point 
x G dK that has u as outer normal. 
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2 /-divergences. 



Let (X, n) be a measure space and let dP = pd\i and dQ = qdfi be prob- 
ability measures on X that are absolutely continuous with respect to the 
measure \i. Let / : (0, oo) ->Rbea convex function. The *-adjoint func- 
tion /* : (0, oo) -> R of / is defined by (e.g. [UJ) 

f*(t) = tf(l/t), tE(0,oo). (1) 

It is obvious that (/*)* = / and that /* is again convex if / is con- 
vex. Csiszar [SJ, and independently Morimoto [37] and Ali & Silvery [T] 
introduced the /-divergence Df(P,Q) of the measures P and Q which, for 
a convex function / : (0, oo) — > R can be defined as (see [17] ) 

Df(P,Q) = f f(^]qdfi + f(0)Q{{xeX:p{x) = 0}) 



where 



'{pq>0} 

+ /*(0) P({xEX:q(x)=0}), 



/(0) = lim/(t) and /*(0) = Km /*(*). (3) 



We make the convention that • oo = 0. 
Please note that 

D f (P,Q) = D r (Q,P). (4) 

With d3]) and as 

/* (0) P({xeX: q(x) = 0}) = / f f ^ pd/i = / / (?) qd^, 

Ji q= o} \pj Js q= o} \qj 



'{9=0} \P/ J{q=0} 

we can write in short 



D f (P,Q) = J x f(fj Qdfi. 



(5) 



For particular choices of / we get many common divergences. E.g. for 
f(t) = tint with *-adjoint function f*(t) = — Int, the /-divergence is the 
classical information divergence, also called Kullback-Leibler divergence or 
relative entropy from P to Q (see [3]) 

L>KiGP||Q)= I phi-dn. (6) 
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For the convex or concave functions f{t) = t a we obtain the Hettinger inte- 
grals (e.g. [17] ) 

H a (P,Q)= [ p a q 1 - a d^. (7) 
Jx 

Those are related to the Renyi divergence of order a, a ^ 1, introduced by 
Renyi [H] (for a > 0) as 

D a (P\\Q) = -!— In ( [ p a q 1 - a d f i) =^—ln(H a (P,Q)). (8) 
a - 1 \Jx J a - 1 

The case a = 1 is the relative entropy D_k-l(P||Q). 

3 /-divergences for convex bodies. 

We will now consider /-divergences for convex bodies K £ )Cq. Let 

/ \ *k(x) (x,N k (x)) 

P K X = 7 AT ( \\n \l7o\ ' = \V\ • 9 

[x, JN K\x)) n n\K°\ n \K\ 

Usually, in the literature, the measures under consideration are probability 
measures. Therefore we have normalized the densities. Thus 

Pk = PK m and Q K = q K m (10) 

are measures on dK that are absolutely continuous with respect to \ik ■ Qk 
is a probability measure and Pk is one if K is in C\. 

Recall that the normalized cone measure ctxik on dK is defined as fol- 
lows: For every measurable set A C dK 



cm K (A) = 



{ta : a G A,t G [0, 1]} 



11) 



The next proposition is well known. See e.g. [39J for a proof. It shows that 
the measures Pk and Qk defined in (fTUj) are the cone measures of K and 
K°. N K : dK -> S 11 - 1 , x -> iV^(x) is the Gauss map. 

Proposition 3.1. Let K be a convex body in R n . Let Pk and Qk be the 

probability measures on dK defined by M0\) . Then 

Qk = cm K , 
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or, equivalently, for every measurable subset A in dK Qk{A) = ctjik{A). 
If K is in addition in C?, then 

P K = N- l N K ocm K « 

or, equivalently, for every measurable subset A in dK 



It is in the sense (|12p that we understand Pk to be the "cone measure" 
of K° and we write Pk = crriK° ■ 

We now define the /-divergences of K G /Co- Note that (x,Nk(%)) > 
for all x € dK and therefore {x 6 dK : qx{x) = 0} = 0. Hence, possibly 
also using our convention • oo = 0, 



Definition 3.2. Let K be a convex body in ICq and let Let f : (0, oo) — > M be 
a convex function. The f -divergence of K with respect to the cone measures 
Pk and Qk is 




(12) 



f (0) P K ({x e dK : q K {x) = 0}) = 0. 




(13) 



Remarks. 



By © and 





K°\(x,N K (x)) n+1 
\K\k k (x) 



n\K°\(x,N K (x)} 



n 



.(14) 



/-divergences can also be expressed as integrals over 
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and 



D ^ QK ^ = LJ{ \K\ )n\K°\h K{ ur (16) 

Examples. 

If K is a polytope, the Gauss curvature kr of K is a.e. on dK. Hence 
D f (P K ,Q K ) = f(0) and D f (Q K , P K ) = f* (0). (17) 

For every ellipsoid £, 

D f (Ps,Qs) = D f (Q £ ,P £ ) = /(l) = (18) 

Denote by Com;(0, oo) the set of functions if) : (0, oo) — > (0, oo) such that 
ip is convex, lim t ^oV'(0 = °°i an d lim^oo ?/"(£) = 0. For ^ e Conv(0, oo), 
Ludwig |21| introduces the L^, affine surface area for a convex body K in 

a,m °l/( sw ) (, ' w '* (19) 

Thus, Lw, affine surface areas are special cases of (non-normalized) /-divergences 
for / = t/j. 

For ip € Conv(0, oo), the *-adjoint function tp* is convex, lim^oV^^) = 
0, and lim^oo ip(t) = oo. Thus tp* is an Orlicz function (see p2]), and gives 
rise to the corresponding Orlicz- divergences D^* (Pr,Qr) and D^* (Qr, Pr)- 

p 

Let p < 0. Then the function / : (0, oo) — > (0, oo), f(t) = t n +p , is 
convex. The corresponding (non-normalized) /-divergence (which is also an 
Orlicz-divergence) is the L p affine surface area, introduced by Lutwak [26] 
for p > 1 and by Schiitt and Werner [47 j for p < l,p ^ — n. See also [T2] , 

It was shown in [52] that all L p affine surface areas are entropy powers 
of Renyi divergences. 

V 

For p > 0, the function / : (0, oo) — > (0, oo), f(t) = t n +p is concave. The 

V 

ra+p i 

corresponding L p affine surface areas J 9K — ^ are examples of 

(x,N K {x)) n +P 

affine surface areas which were considered in [23] and [21]. Those, in turn 
are special cases of (non-normalized) /-divergences for concave functions /. 



6 



Let f(t) = t In t. Then the *-adjoint function is /* (t) = — In t. The corre- 
sponding /-divergence is the Kullback Leibler divergence or relative entropy 
D K l{Pk\\Qk) from P K to Q K 



D K l(Pk\\Qk)= [ 
Jdi 



K K {x) 



In 



\K\k k (x) 



, dK n\K°\(x,N K (x)) n \\K°\(x,N K (x)) n+] 
The relative entropy Dkl(Qk\\Pk) from Qk to Pk is 



r dfi K . (20) 



D K l{Qk\\Pk) = Df* (Pk , Qk 

r (x,N K ( x)) , ( \l\--\''.r. A" K (.<•)',"+' 



log 



(21) 



Those were studied in detail in |39j . 



Equations (fl~5j) and ([16]) of the above remark lead us to define /-divergences 
for several convex bodies, or mixed /-divergences. 

Let K%, . . . ,K n be convex bodies in /Co- Let u £ S"™ -1 . For 1 < i < n, 
define 

1 , . fKi(u)h Ki (u) 



n\K°\h Kl (u) 



and measures on S n 1 by 

Pk, = Pk, cr and Q K . = q Ki a. 



(23) 



(24) 



Let fi : (0, oo) — > R, 1 < i < n, be convex functions. Then we define the 
mixed /-divergences for convex bodies . . . , in /Co by 



Definition 3.3. 



£>/i.../„ [Pkj x • ■ • x P Kn , Q Kl x • ■ • x QifJ 



and 



D h ...f n {Q Kl x • • • x Qk^Pkj. x---xPk„ 



i=i 



n 

i=i 



QKi 



PK, 



da 



da. 
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Note that 

Df*... f *(P Kl x • • • x P Kn , Q Kl x • • • x Q Kn ) 

= Dfi-fniQ^ x • • • x Q Kn , P Kl x • • • x P Kn ). 

Here, we concentrate on /-divergence for one convex body. Mixed /- 
divergences are treated similarly. We also refer to |55| . where they have 
been investigated for functions in Conv(0, oo). 

The observation ()17|) about polytopes holds more generally. 

Proposition 3.4. Let K be a convex body in /Co and let f : (0, oo) — > R be 

a convex function. If K is such that \xk ({pk > 0}) = ; then 

D f {P K ,Q K ) = /(0) and D f (Q K ,P K ) = /*(0). 

Proof, fix {{pk > 0}) = iff Qk {{pk > 0}) = 0. Hence the assumption 
implies that Qk ({pk = 0}) = 1. Therefore, 

D/(Pk,Qk) = / / ( — J QKdfiR 
JdK \QkJ 

= / / ( — ) q K dnK + f ( — ) qxdnK 

J{PK>0} \QK J J{pk=0] KIkJ 

= /(o). 

By @, D f (Q K ,P K ) = Df* (Pk,Qk) = /*(0). 

The next proposition complements the previous one. In view of (|18p and 
(|27p . it corresponds to the affine isoperimetric inequality for /-divergences. 
It was proved in [T7] in a different setting and in the special case of / € 
Conv(0, oo) by Ludwig |21j . We include a proof for completeness. 

Proposition 3.5. Let K be a convex body in /Co and let f : (0, oo) — > R be 

a convex function. If K is such that \xk {{pk > 0}) > 0, then 

D f (P K ,Q K ) > f ( ^(fr^>o>) ) Qk {{pk > ° }) + /(0) Qa ' (fe = ° }) 

(25) 

and 

D f (Q K ,P K ) > f* ( n K{ n K Z°l\ ) ® K ^ K > »+/*(°) ^ (fr* = °» ■ 

(26) 
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If K is in C\, or if f is decreasing, then 

Df{P K ,QK)>f{l) and D f (Q K ,P K )>f*(l) = f(l). (27) 

Equality holds in [25\) and (26)) iff f is linear or K is an ellipsoid. If K 
is in C^_, equality holds in both inequalities {2 r ty iff f is linear or K is an 
ellipsoid. If f is decreasing, equality holds in both inequalities \21^ iff K is 
an ellipsoid. 

Remark. It is possible for / to be deceasing and linear without having 
equality in ([27]) . To see that, let f(t) = at + b, a < 0, b > 0. Then, for 
polytopes K (for which fi K ({p K > 0}) = 0), Df(P K ,Q K ) = f(0) = b > 
/(l) = a + b. But, also in the case when < fix ({pk > 0}) < 1, strict 
inequality may hold. 

Indeed, let e > be sufficiently small and let K = B^e) be a "rounded" 
cube, where we have "rounded" the corners of the cube with sidelength 
2 centered at by replacing each corner with eB^ Euclidean balls. Then 
D f (P K ,Q K ) = b + aP K {{p K > 0}) > b + a = /(l). 

Proof of Proposition 13.51 Let K be such that \xk {{pk > 0}) > 0, which 
is equivalent to Qk ({pk > 0}) > 0. Then, by Jensen's inequality, 

D f (P K ,Q K ) = Qk({pk>o}) [ f(—) n rr^hns 

J{pk>o} \QkJQk{{pk>0}) 
+ 7(0) Qk ({pk = 0}) 

> Qk ({pk > 0}) / ( n Ki u K Vnx\ ) + KM* = °» ■ 
\Qk({pk > o})y 

Inequality Qgft follows by @, as D f (Q K ,P K ) = Df* (Pk, Qk)- 

UK is in C\, Q K ({pk > 0}) = 1, Qk ({pk = 0}) = 0, P K ({pk > 0}) = 
1 and P K ({pk = 0}) = 0. Thus we get that D f (P K ,Q K ) > f(l) and 
D f (Q K ,P K )>f*(l) = f(l). 

If / is decreasing, then, by Jensen's inequality 

D f (P K ,Q K ) = f f q K dfi K > f ( [ PKdp K )>f(l)- 

JdK V Qk J \JdK J 

The last inequality holds as J dK PKdpK < 1 and as / is decreasing. 
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Equality holds in Jensen's inequality iff either / is linear or |p is con- 
stant. Indeed, if f(t) = at + b, then 

D f (P K , Qk) = I ( o— + b] q K dii K + /(0) Q K {{p K = 0}) 

J{p K >0} V QK J 

= aP K ({ PK >0}) + f(0). 

If / is not linear, equality holds iff ^ = c, c a constant. As by assumption 
Mif ({PA' > 0}) > 0, c ^ 0. By a theorem of Petty [40J, this holds iff -fT is an 
ellipsoid. 

The next proposition can be found in |17| in a different setting. Again, 
we include a proof for completeness. 

Proposition 3.6. Let K be a convex body in /Co and let f : (0, oo) — > R be 

a convex function. Then 



D f (P K ,Q K )<f(0)+f*(0)+f(l) 
and 

D f (Q K ,P K )<f(0)+t(0)+f(l) 



Qk({0 <Pk< qK})+P K {{0 <QK< Pk}) 



Qk({0 <Pk< q K })+P K ({0 <q K < Pk}) 



If f is decreasing, the inequalities reduce to Dj(Pk,Qk) < /(0) respectively, 
D f (Q K ,P K )<r(0). 

Proof. It is enough to prove the first inequality. The second one follows 
immediately form the first by (J4]). 
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D f (P K ,Q K ) 



f 



dK 



] q K d, 



[ f (—) qxd^t + /(O) Q K ({ PK = 0}) 
J{pk>o} \1kJ 

f ( — ) QKd/i 
'{0< P K}n{/'>0} \QkJ 



/(O) Qi^({pA' = 0}) + / 



+ 



/ ( — ) 

{o< P K}n{/'<o} \QkJ 



< /(O) 



Qic(W = o}) + ({px > 0} n {/' < o}) 



+ 



/ 



( — ) QKdfi + 



f f — ) QKdn 

{0<q K <p K }n{f>0} \QK / 



{0< PK <qK}n{f>0} 

< /(O) + /(l) ({0 <p K < q K } n {/' > 0}) 



+ 



{0<q K <p K }r\{f>>0} 



Pk J 



p K dfi 



/(O) + /(l) Q x ({0 < p K < q K } n {/' > 0}) 

<1K 



{o<q K <PK}n{f'>o}n{(f*y>o} 



r 



+ 



/* 



PK 

qK_ 

PK 



p K d\x 

PKdfi 



'{o<?ic<PK}n{/'>o}n{(/*)'<o} 
< /(O) + /(l) Qx ({0 < p K < Qk} n {/' > 0}) 

+ ({o < < n {/' > 0} n {(/*)' > o}) 

+ /* (0) p k ({o <q K < pk} n {/' > 0} n {(/*)' < o}) 

< /(O) + r (0) ({0 < q K < Pk] n {/' > 0}) 

+/(1) Q K ({0 <p K < q K } n {/' > 0}) + P A -({0 < q K < p K } D {/' > 0}) 



It follows from the last expression that, if / is decreasing, the inequality 
reduces to D f (P K ,Q K ) < /(0). 

The next proposition shows that /-divergences are GL(n) invariant and 
that non-normalized /-divergences are SL(n) invariant valuations. For func- 
tions in Conv(0, oo), this was proved by Ludwig [21]. 

For functions in Conv(0, oo) the expressions are also lower semicontin- 
uous, as it was shown in [21J. However, this need not be the case anymore 
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if we assume just convexity of /. Indeed, let f(t) = t 2 and let K = B£ 
be the Euclidean unit ball. Let (Kj)j^ be a sequence of polytopes that 
converges to B%. As observed above, D /(Prt 3 , Qif^) = /(0) = for all j. 

But Df(P B n,Q B n) =/(l) = 1. 

Let Pft- = ( x ^k{x))"- and = { x ? n k(x))hk- Then we will denote by 
Dj(Pk,Qk) and Df(Qx, Pk) the non-normalized /-divergences. We will 
also use the following lemma from [4T] for the proof of Proposition 13.81 

Lemma 3.7. Let K be a convex body in /Co- Let h : dK — >• R be an integrable 
function, and T : R n — > R n an invertible, linear map. Then 

[ h(x)dfj, K = \det(T)\~ 1 [ KFfzJlW (Mr? \\M\ d ^(K)- 
JdK JdT(K) \\T n {N K (T L (y)))\\ 



Proposition 3.8. Let K be a convex body in ICq and let f : (0, oo) — > R be a 
convex function. Then Dj(Pk,Qk) o-nd Dj(Qk,Pk) are GL(n) invariant 
and Df(Px,QK) and Df(Qx, Pk) are SL(n) invariant valuations. 

Proof. We use (e.g. [37]) that 

(x,N K (x)) 



(T(x),N T(K) (T(x)) 



\T-*(N K (x))\\' 
and 

k k (x) = \\T- u (N K (x))\\ n+1 det(T)\ T{K) (T( X )) 
and Lemma 13.71 to get that 

D f (P K ,Q K ) = [ f( P -^]qK{x)d^x) 

JdK \Qk{x)J 

= 1 f t_ Igggj) lK(T-Hy)W T{K) 

\det(T)\J dT{K) \\T-U(N K (T-l(y)))\\ 
= Df(P T ( K ),Q T ( K )). 

The formula for Dj(Qk,Pk) follows immediately from this one and (JJJ. 
The SL{n) invariance for the non-normalized /-divergences is shown in the 
same way. 

Now we show that Df(Ppc, Qk) and Df(Qx, Pk) are valuations, i.e. for 
convex bodies K and L in /Co such that K U L € /Co, 

D f (P K uL, Qkul) + D f (P KnL , Q KnL ) = D f (P K ,Q K ) + D f (P L ,Q L ). (28) 
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Again, it is enough to prove this formula and the one for Df(Qx, Pk) follows 
with (|3|). To prove (|28|). we proceed as in Schiitt [H]. For completeness, we 
include the argument. We decompose 

d(K U L) = (dK n dL) U (dK n L c ) U (K c n dL), 

d(K n L) = (dK n dL) U (<9if n intL) U (intK n 9L), 

SET = (Slf n 9L) U (dK n L c ) U n intL), 

dL = (dK n dL) u (a^: c n dL) U (intif n 

where all unions on the right hand side are disjoint. Note that for x such 
that the curvatures kk(x), kl(x), kkul(x) and kkcil(x) exist, 

(x,N K (x)) = (x,N L (x)) = (x,N KnL (x)} = (x,N KuL (x)} (29) 

and 

kkul(x) = mm{KK(x),KL(x)}, KKnL(x) = max{KK(x),Ki(x)}. (30) 

To prove (I28p . we split the involved integral using the above decompositions 
and ([29]) and (150"j) . 

4 Geometric characterization of /-divergences. 

In |52| . geometric characterizations were proved for Renyi divergences. Now, 
we want to establish such geometric characterizations for /-divergences as 
well. We use the surface body [47] but the illumination surface body [54] or 
the mean width body [13] can also be used. 

Let K be a convex body in R n . Let g : dK -> R be a nonnegative, 
integrable, function. Let s > 0. 

The surface body K g>s , introduced in [47] . is the intersection of all closed 
half-spaces H + whose defining hyperplanes H cut off a set of /^^-measure 
less than or equal to s from dK. More precisely, 

K g , s = n h+ - 

IdKnH- 9d^K<s 

For x G dK and s > 

x s = [0,x] n dK 9yS . 
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The minimal function M g : dK 

Wl ] . , fdKnH-(x s ,N Kg , s (x s ))9 dfi K 

M (x) = mi 7 — — v (31) 

o< s vol n ^{dKnH-(x s ,N Kgs (x s ))) 

was introduced in [47]. H(x,£) is the hyperplane through x and orthogonal 
to £. H~(x,£) is the closed halfspace containing the point x + £, H + (x,£) 
the other halfspace. 

For x G dK, we define r(x) as the maximum of all real numbers p so 
that B^(x — pNfc(x), p) C if. Then we formulate an integrability condition 
for the minimal function 

dp K (x) 



2 



9K (M g (x))"~-L r(x) 



< oo. (32) 



The following theorem was proved in [47J. 

Theorem 4.1. Let K be a convex body in W 1 . Suppose that f : dK — > R is 
an integrable, almost everywhere strictly positive function that satisfies the 
integrability condition Then 

Y \K\-\K g , a \ f nf 1 
c n hm 2 = / — —dpK, 

s»-i JdK gn-i 

— 1 2 

where c n = 2\B^ | n_1 • 



Theorem 14.11 was used in [U] to give geometric interpretations of L p 
affine surface area and in [52] to give geometric interpretations of Renyi 
divergences. Now we use this theorem to give geometric interpretations of 
/-divergence for cone measures of convex bodies. 



For a convex function / : (0, oo) 



let gf, hf : dK — > R be defined as 



9 fix) 



„ I i/oi n in 

n\K n \K\ - 



PkQk 



flPK 

> qK 



n-1 



(33) 



and 



h f ix) = g f *(x) 



n\K°\n n \K\ n - 



ik/pI 



K 



f ( PK 



n-1 



(34) 
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Corollary 4.2. Let K be a convex body in JCq and let f : (0, oo) — > R be 
convex. Let g/,hf : OK — > R be defined as in \33\) and {3$ - If 9f and hf 
are integrable, almost everywhere strictly positive functions that satisfy the 
integrability condition \3£fy , then 



\ K \ ~ \ K Q f s\ 

lim — L^£U = Df(P K ,Q K ) 



S " 



-1 



and 



\K\ ~ \Kh f s\ 
c n lim j — T — = D f (Q K , Pk) 



-1 



Proof. The proof of the corollary follows immediately from Theorem 14.11 
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